
IS CLAIMED IS: 




The use of multiple threap in association with a network processor and accessible data 
available in a tree search structure, including the steps of: 

a) providing multiple instruction execution threads as independent processes in a 



sequential time frame; 

b) queueing the multiple execution threads to have overlapping access to the 
accessible data available in said tree search structure; 

c) executing a/first thread in the queue; and 

d) transferrin* control of the execution to the next thread in the queue upon the 
occurrence of an event that causes execution of the first thread to stall. 

2. The use of the multiple threads according to claim 1 wherein the control of the execution 
is temporarily ftransferred to the next thread when execution stalls due to a short latency 
event, and the control is returned to the original thread when the event is completed. 

3. The use of multiple threads according to claim 2 wherein a processor instruction is 
encoded to /select a short latency event. 

4. The use of the multiple threads according to claim 1 wherein full control of the execution 
is transfei red to the next thread when execution of the first thread stalls due to a long 
latency ev snt. 
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The use of multiple threads according to claim 4 wherein a processor instruction is 
encoded to select a long latency/event. 



1 6. The use of multiple threads according to claim 1 including queueing the threads to provide 

2 rapid distribution of access jto shared memory. 
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The use of the multiple tWeads according to claim 1 wherein the threads have overlapping 
access to shared remote storage via a pipelined coprocessor by operating within different 
phases of a pipeline of the coprocessor. 

The use of the multinle threads according to claim 1 further including the step of providing 
a separate instruction pre-fetch buffer for each execution thread, and collecting 
instructions in a prefetch buffer for its execution thread when the thread is idle and when 
the instruction banpwidth is not being fully utilized. 



1 9. The use of the multiple threads according to claim 1 wherein the threads are used with 

2 zero overhead to switch execution from one thread to the next. 

1 1 0. The use of the rr^iltiple threads according to claim 9 wherein each thread is given access to 
general purpose Registers and local data storage to enable switching with zero overhead. 
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A network processor that uses multiple threads to access data, including: 

a) a CPU configured with/multiple instruction execution threads as independent 
processes in a sequent/al time frame; 

b) a thread execution cofetrol for 

1) queueing thef multiple execution threads to have overlapping access to the 
accessible c|ata; 

2) executing k first thread in the queue; and 

3) transferring control of the execution to the next thread in the queue upon 
the occurrence of an event that causes execution of the first thread to stall. 



12. A processing system utilizing multiple threads according to claim 1 1 wherein the thread 
execution control includes control logic for temporarily transferring the control to the next 
thread when execution stalls due to a short latency event, and for returning control to the 
original thread when the latency event is completed. 



13. The processing systei i according to claim 1 1 wherein a processor instruction is encoded to 
select a short latency event. 

14. The processing systei n according to claim 1 1 wherein the control transfer means includes 
the means for transfe ring full control of the execution to the next thread when execution 
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of the first thread stalls due to a/long latency event. 



15. The processing system according to claim 14 wherein a processor instruction is encoded to 
select a long latency event. / 

16. The processing system according to claim 1 1 including means to queue the threads to 
provide rapid distribution of access to shared memory. 

17. The processing system according to claim 16 wherein the threads have overlapping access 
to shared remote storage via a pipelined coprocessor by operating within different phases 
of a pipeline of the coprocessor. 

18. The processing system according to claim 1 1 further including a separate instruction 
pre-fetch buffer for each execution thread, and means for collecting instructions in a 
prefetch buffer for an idle execution thread when the instruction bandwidth is not being 
fully utilized. I 

19. The system accorc ing to claim 1 1 wherein the processor uses zero overhead to switch 
execution from on 3 thread to the next. 

20. The system accorc ing to claim 19 wherein each thread is given access to an array of 
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general purpose registers and local 



lata storage to enable switching with zero overhead. 



The system according to claim 20 wherein the general purpose registers and the local data 
storage are made available to the processor by providing one address bit under the control 
of the thread execution control Iqgic and by providing the remaining address bits under 
the control of the processor. 



1 22. The system according to claim CO wherein the processor is capable of simultaneously 

2 addressing multiple register arrays, and the thread execution control logic includes a 

3 selector to select which array ]vi\l be delivered to the processor for a given thread. 



1 23. The system according to clain l 

2 processor, an index register is 

3 control has no address control 
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A network processor configuration comprising 



a CPU with multiple 



20 wherein the local data storage is fully addressable by the 
contained within the register array, and the thread execution 
over the local data storage or the register arrays. 



reads; 



an instruction memory! and a separate prefetch queue for each thread between the 
instruction memory and the (CPU; 

an array of general purposes registers, said array communicating with the CPU; 
a local data storage including separate storage space for each thread 
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a thread execution control for the general register array and the local data storage; 
a first coprocessor connecting the CPU to a local data storage; 
a shared remote storage; And 

a pipelined coprocessor connecting the shared remote and the CPU. 



1 25. The processor configuration according to claim 24 wherein the thread execution control 

2 includes a priority FIFO, a plurality of thread control state machines, one for each 

3 execution thread, and an arbiter. 
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The use of prefetch buffers/in connection with a plurality of independent 
instruction threads used to/process data in a Network Processor comprising the steps of: 

a) associating each thread with a prefetch buffer; 

b) determining whether a buffer associated with an execution thread is full; 

c) determinin \ whether the thread associated with the buffer is active; and 

d) during per ods that the buffer is not being used by an active execution 
bling the buffer to prefetch instructions for the execution thread. 



thread, em 



A thread execution contrc 
in a network processor co nprising: 

a) a priority F IFO; 

b) a plurality c 



useful for the efficient execution of independent threads 



f thread control state machines, one for each thread; and 
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b) 



c) 



c) an arbiter for determining the thread execution priority among multiple 
threads. 

The thread execution control according to claim 27 wherein the FIFO includes : 

a) means for loadi rig a thread number into FIFO when a packet is dispatched 
to the processoi ; 

means for unloi iding a thread number from the FIFO when a packet has 
for transmission; 

thread number transfer from highest priority to lowest priority in the FIFO 
when a long latency event occurs, and 

d) the thread outl its of the FIFO used to determine priority depending on the 
length of time i thread has been in FIFO. 

The thread execution control according to claim 27 wherein the arbiter controls the 



been enqueued 



priority of execution of multip 



expression: 



G n =R n {(P A =] 
where: G is a grant 

R n is a request 

P A , P B andP c 



e independent threads based on the Boolean 



)+R PA * (P B =n)+R PA Rp B (P c =n)' - } 



fi om a given thread; 



represent threads ranked by alphabetical subscript 
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according to priority; 


1 A 
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„ is a subscript identifying a thread by the bit or binary number 


11 


comprising 




1 O 
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a) 


determining whether a request R is active or inactive; 


13 


b) 


determming the pnonty of the threads; 


14 


c) 


matching the request R with the corresponding thread P; and 


15 


d) 


granting a request for execution if the request is active and if 


16 




the corresponding thread P has the highest priority. 


Q 
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The thread execution control according to claim 27 wherein the thread control state 
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machine comprises control logic to : 




a) 


dispatch a packet to a thread; 


4 


b) 


move the thread from an initialize state to a ready state; 


I 5 


c) 


request execution cycles for the packet; 


:f» 6 


d) 


move the thread to the execute state upon grant by the arbiter of an 


« - 
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execution cycle; 


8 


e) 


continue to request execution cycles while the packet is queued in the 


9 




execute state; and 


10 


f) 


return the packet to the initialize state if there is no latency 


11 




event, or send the packet to the wait state upon occurrence of a latency 


12 




event. 
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